How do I refresh or sync delegated calendars from Google Calendar in Calendar?

My apologies if this has been covered before - I looked for hours to find something and I haven't.

My husband and I share calendars so that we can be on the same page with our separate work schedules. His is a calendar via Google Calendar through his work's Corporate/Business Google account. He shared it with me with read access only.

His calendar shows up in my Google Calendar just fine and I'm able to refresh it. When I go to Calendar on my Mac it shows up as a Delegates account (can't figure out how to make it any other form of account) and has a warning/caution symbol next to it. When he changes an event on his side it does not update mine.

I have tried "Command R", I've tried refreshing from Google, then he deleted my access and then re-added me. Nothing updates it. I've quit Calendar and re-opened, no changes. Does anyone have any ideas of what is going on? When I look at an Availabilty screen it says "You can't see availability for events in accounts that are currently unreachable". How do I make it reachable? I've tried many other things in the Calendar application, nothing has relieved this issue.

We are both running OS X Yosemite 10.10.4. He uses the Google Calendar since his team uses it. I use Calendar since I have multiple accounts I wanted to keep in Mail/Calendar instead of Google.

Thank you,

Ashwdwrd